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Abstract 

In this paper, we study several decision problems for functional weighted automata. To associate values 
with runs, we consider four different measure functions: the sum, the mean, the discounted sum of weights 
along edges and the ratio between rewards and costs. On the positive side, we show that the existential 
and universal threshold problems, the language inclusion problem and the equivalence problem are all 
[ decidable for the class of functional weighted automata and the four measure functions that we consider. 

' On the negative side, we also study the quantitative extension of the realizability problem and show that 

^1 it is undecidable for sum, mean and ratio. Finally, we show how to decide if the quantitative language 

O ' defined by a functional weighted discounted sum automaton can be defined with a deterministic automata 

I (it was already known for sum and mean). 
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O . f1 Introduction 

, Recently, there have been several efforts made to lift the foundations of computer aided verification 

' and synthesis from the basic Boolean case to the richer quantitative case, e.g. 1 10, 8 , 1 1. This paper 

belongs to this line of research and contributes to the study of quantitative languages over finite 

■ Our paper proposes a systematic study of the algorithmic properties of several classes of func- 

tional weighted automata (defining quantitative languages). A functional weighted automaton is a 
nondetenninistic weighted automaton such that any two accepting runs pi, p2 on a word w associate 
with this word a unique value V(pi) = V(p2)- As we show in this paper, several important veri- 
fication problems are decidable for nondeterministic functional weighted automata while they are 
undecidable (or unknown to be decidable) for the full class of nondeterministic weighted automata. 
K/i \ As functional weighted automata are a natural generalization of unambiguous weighted automata, 

5_j ' and as unambiguity captures most of the nondeterminism that is useful in practice, our results are 

both theoretically and practically important. Also, the notion of functionality leads to useful insight 
into the relation between deterministic and nondeterministic weighted automata and into algorithmic 
idea for testing equivalence for example. 

In this paper, we study automata in which an integer weight, or a pair of integer weights, is 
associated with each of their transitions. From those weights, an (accepting) run p on a word w 
associates a sequence of weights with the word, and this sequence is mapped to a rational value by a 
measure function. We consider four different measure functions': (i) Sum computes the sum of the 
weights along the sequence, (m) Avg returns the mean value of the weights, (in) DsuitIa computes 



We do not consider the measure functions Min and Max that map a sequence to the minimal and the maximal 
value that appear in the sequence as the nondetenninistic automata that use those measure functions can be made 
deterministic and all the decision problems for them have known and simple solutions. 
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the discounted sum of the weights for a given discount factor A G Qn]0,l[,and (iv) Ratio is applied 
to a sequence of pairs of weights, and it returns the ratio between the sum of weights appearing as 
the first component (rewards) and the sum of the weights appearing as the second component (costs). 
The value associated with a word w accepted by A is denoted by La{w). While Sum and, to some 
extent, Avg are known because they can be seen as operations over a semiring of values ||20l . the 
case of DsurriA and Ratio are less studied. Those two measures are motivated by applications in 
computer aided verification and synthesis, see for example [fT2l l71. 

Contributions Functionality is a semantical property. We show that it can be decided for the four 
classes of measure functions that we consider (either in polynomial time or polynomial space). Then 
we solve the following decision problems, along the line of [lO]. First, we consider threshold prob- 
lems. The existential (universal, respectively) threshold problem asks, given a weighted automaton 
A and a threshold z/ G (Q, if there exists a word (if for all words, respectively) w accepted by A: 
La{w) > V. Those problems can be seen as generalizations of the emptiness and universality prob- 
lems for finite state automata. Second, we consider the quantitative language inclusion problem that 
asks, given two weighted automata A and B, if all words accepted by A are also accepted by B, and 
for all accepted words w of A, we have La(u') < Lb{w). We show that all those problems are de- 
cidable for the four classes of measure functions that we consider in this paper when the automaton 
is functional. We show that the inclusion problem is PSpaceC for Sum, Avg and DsumA. For 
Ratio, we show decidability of the problem using a recent algorithm to solve quadratic diophantine 
equations |14|, this is a new deep result in mathematics and the complexity of the algorithm is not 
yet known. Note that those decidability results are in sharp contrast with the corresponding results 
for the full class of nondeterministic weighted automata: for that class, only the existential threshold 
problem is known to be decidable, the language inclusion problem is undecidable for Sum, Avg, 
and Ratio while the problem is open for Dsum^. We also show that the equivalence problem can be 
decided in polynomial space for Ratio via an easy reduction to functionality. 

Then, we consider a quantitative variant of the realizability problem introduced by Church, which 
is part of the foundations of game theory played on graphs f23l and synthesis of reactive systems flV\ . 
It can be formalized as a game in which two players alternates in choosing letters in their respective 
alphabet. By doing so, they form a word which is obtained by concatenating the successive choices 
of the players. The realizability problem asks, given a weighted automaton A, alphabet S = Ei x E2, 
if there exists a strategy for choosing the letters in Si in the word forming game such that no matter 
how the adversary chooses his letters in S2, the word w that is obtained belongs to the language 
of A and A{w) > 0. We show that this problem is undecidable for Sum, Avg, and Ratio even 
when considering unambiguous automata (the case Dsum^ is left open). However, we show that the 
realizability problem is decidable for the deterministic versions of the automata studied in this paper. 
This motivates the study of the determinizability problem. 

The determinizability problem asks, given a functional weighted automaton A, if the quantitative 
language defined by A is also definable by a deterministic automaton. This problem has been solved 
for Sum, Avg in |16|. It is known that Dsum^-automata are not determinizable in general ifTOl . 
We give here a decidable necessary and sufficient condition for the determinizability of functional 
DsumA automata, and we show how to construct a deterministic automaton from the functional one 
when this is possible. 

Related Works Motivated by computer-aided verification issues, our work follows the same line 
as fTO'l. However |10| is mainly concerned with weighted automata on infinite words, either non- 
deterministic, for which some important problems are undecidable (e.g. inclusion of Avg -automata), 
or deterministic ones, which are strictly less expressive than functional automata. The Ratio measure 
is not considered either Their domains of quantitative languages are assumed to be total (as all states 
are accepting and their transition relation is total) while we can define partial quantitave languages 
thanks to an acceptance condition. 

Weighted automata over semirings have been extensively studied (see ll20l for a survey), and 
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more generally rational series |4jj . For instance, the functionality problem for weighted automata 
over the tropical semiring, i.e. Sum-automata, is known to be in PTime lfT6l . Moreover, it is 
known that determinizability of functional Sum-automata is decidable in PTime ||T6| . as well as 
for the strictly more expressive class of polynomially ambiguous Sum-automata 1 15l, for which the 
termination of Mohri's determinization algorithm |20| is decidable. However, the Dsum a and Ratio- 
automata are not automata over any semiring, and therefore results on automata over semirings 
cannot be directly applied to those measures. The technics we use for deciding functionality and 
determinization are inspired by technics from word transducers [22, 6, 3 ,11, 24|. 

The functionaUty problem has been studied for finite state (word) transducers. It was proved to 
be decidable in f22l, and later in [6|. Based on a notion of delay between runs, an efficient PTime 
procedure for testing functionality has been given in [3J. The functionality problem for Sum,Avg 
and Dsum^-automata is also based on a notion of delay. Based on the twinning property ifTTI and the 
notion of delay, efficient procedures for deciding determinizability can be devised |I3] l24ll . This also 
inspired our determinization procedure for functional DsumA-automata. In Q, Boker et. al. show 
that DsumA-automata on infinite words with a trivial accepting condition (all states are accepting), 
but not necessarily functional, are determinizable for any discount factor of the form 1/n for some 
n G N>2. Their proof is based on a notion of recoverable gap, similar to that of delays. In our paper, 
we provide a sufficient and necessary condition to check whether a functional Dsum^-automaton 
(over finite words) is determinizable. Finally in lfT3l . the relation between discounted weighted 
automata over a semiring and weighted logics is studied. 

To the best of our knowledge, our results on DsumA and Ratio-automata, as well as on the real- 
izability problem, are new. Our main and most technical results are functionality of DsumA and 
Ratio-automata, inclusion problems, determinizability of functional Dsum^-automata, undecidabil- 
ity of the realizability of unambiguous Sum-automata, and solvability of the deterministic versions 
of the realizability problem. The latter reduce to games on graphs that are to the best of our know- 
ledge new, namely finite Sum, Avg, DsurriA, Ratio-games on weighted graphs with a combination of 
a reachability objective and a quantitative objective. 

Omitted proofs can be found in the Appendix section. 

fz Quantitative Languages and Functionality 

Let S be a finite alphabet. We denote by S+ the set of non-empty finite words over S. A quantitative 
language L over S is a mapping L : ^ Q U {-L}^. For all ui E S+, L{w) is called the value 
of w. L(w) =_L means that the value of w is undefined. For all x G Q, we let max(x, _L) = x, 
max(_L, x) ^ X and max(±, ±) —L. 

Let n > 0. Given a finite sequence v = vq . . . Vn of integers (resp. a finite sequence v' — 
(ro, Co) . . . (r„, c„) of pairs of natural numbers, q > for all i) and A e Q such that < A < 1, we 
define the following functions: 



For empty sequences e, we also set Sum(e) = Avg(e) = DsumA(e) ~ Ratio(e) = 0. 
Weighted Automata Let V G {Sum, Avg, DsurriA, Ratio}. A weighted V -automaton over E is a 
tuple A — {Q, qi, F, S, 7) where Q is a finite set of states, F is a set of final states, (JCQxExQis 
the transition relation, and 7 : (5 — > Z (resp. 7 : (5 — > N x (N — 0) if y = Ratio) is a weight function. 



^ As in 1101 . we do not consider the empty word as our weighted automata do not have initial and final weight 
functions. This eases our presentation but all our results carry over to the more general setting with initial and final 
weight function |20|. 
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W Figure 1 Examples of Sum-automata 



The size of A is defined by \ A\ = \Q\ + \5\ + J^tes ^og2{l{i))- Note that (Q, g/, F, 5) is a classical 
finite state automaton. We say that A is deterministic (resp. unambiguous) if {Q.,qi, F, S) is. 

A run p of j4 over a word w = cti . . . (t„ e E* is a sequence p ~ qo<Jiqi<J2 ■ ■ ■ c^nQn such that 
qo = qi and for alH e {0, . . . , n — 1}, (qj, dj+i, g^+i) G (5. It is accepting if (7„ G F. We write 
/o : go — > qnio denote that p is a run on w starting at qo and ending in qn ■ The domain of A, denoted 
by dom{A), is defined as the set of words w G E+ on which there exists some accepting run of A. 

The function V is naturally extended to runs as follows: 

, , f V{'j{qo,ai,qi) . . .j{qn-i,<Jn,qn)) if p is accepting 
|_ _L otherwise 

The relation induced by A is defined by = {{w, V{p)) \ w G p is a accepting run of A on 
It is functional if for all words w G S^, we have \{v \ {w, v) G R\, v 7^-L}| < 1. In that case we 
say that A is functional. The quantitative language La ■ S+ — > Q U {_L} defined by A is defined 

by : w H> max{w | {w, v) G R^}- 

► Example 1 . Fig. [T] illustrates two Sum-automata over the alphabet {a, b}. The first automaton 
(on the left) defines the quantitative language w G S+ ^ max{^ a {w),^b{w)), where 4t^a{w) 
denotes the number of occurences of the letter a in w. Its induced relation is {{w, ^a{w)) \ w G 
E+} U {{w,^ii{w)) I w G The second automaton (on the right) defines the quantitative 
language that maps any word of length at least 2 to the number of occurences of its last letter. 

We say that a state q is co-accessible (resp. accessible) by some word it; G S* if there exists 
some run p : q ^ qj for some qf £ F (resp. some run p : qj ^ q). If such a word exists, we 
say that q is co-accessible (resp. accessible). A pair of states (q, q') is co-accessible if there exists 
a word w such that q and q' are co-accessible by w. In the sequel, we use the term V^-automata to 
denote either Sum, DsumA, Avg or Ratio-automata. 

Functional Weighted Automata The Sum-automaton on the left of Fig. [T]is not functional (e.g. 
the word abb maps to the values 1 and 2), while the one of the right is functional (and even unam- 
biguous). 

Concerning the expressiveness of functional automata, we can show that deterministic automata 
are strictly less expressive than functional automata which are again strictly less expressive than 
non-deterministic automata. 

► Lemma 2. Let V G {Sum, Avg, DsumA, Ratio}. The following hold: 

Deterministic < Functional There exists a functional V -automaton that cannot be defined by any 
deterministic V -automaton; 

Functional < Non-deterministic There exists a non- deterministic V -automaton that cannot be 
defined by any functional V -automaton. 
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Proof. Let V G {Sum, Avg, DsutriA, Ratio}. The automata of Fig. [T]can be seen as l/-automata 
(with a constant cost 1 if V ~ Ratio). The right F-automaton cannot be expressed by any determ- 
inistic ^-automaton because the value of a word depends on its last letter The left ^-automaton 



As proved in Appendix, functional ^-automata are equally expressive as unambiguous l/-automata 
(i.e. at most one accepting run per input word). However we inherit the succinctness property of non- 
deterministic finite state automata wrt unambiguous finite state automata, as a direct consequence 
functional V-automata are exponentially more succinct than unambiguous V^-automata. Moreover, 
considering unambiguous l/-automata does not simplify the proofs of our results neither lower the 
computational complexity of the decision problems. Finally, testing functionality often relies on a 
notion of delay that gives strong insights that are useful for determinization procedures, and will 
allow us to test equivalence of functional (and even unambiguous) Ratio-automata with a better 
complexity than using our results on inclusion. 

^3 Functionality 

In this section, we show that it is decidable whether a F-automaton A — {Q,qi, F,S, 7) is functional 
for all V e {Sum, Avg, Dsum^, Ratio}. 

3.1 Functionality of Sum and Avg-Automata 

It is clear that a Sum-automaton A is functional iff the Avg-automaton A is functional. Indeed, let 

w e dom(A) and wi, e Z. We have {w, vi), {w, V2) G R^J'"' iff (w, ^^), {w, f^^) G R'^^. The 
result follows as ui 7^ W2 iff 1^ So we can rephrase the following result of 1 16|: 

► Theorem 3 ( [1 6j ). Functionality is decidable in PTime/or Sum and Avg-automata. 

The algorithm of fTFl for checking functionality of Sum-automata is based on the notion of 
delay between two runs. This notion has been first introduced for deciding functionality of finite 
state (word) transducers jSj. Let w G S+ and p, p' be two runs of a Sum-automaton A on w. The 
delay between p and p' is defined as delay(/9, p') = Sum(p) — Sum(p'). For all pairs (p, g), we define 
delay(p, q) as the set of delays delay(p, q) = {delay(p, p') \ 3w e T,* ■ p : qi ^ p, p' : qi ^ q}. 

It is proved in lfT6l that a Sum-automaton A is functional iff for all co-accessible pairs of states 
{p, q), |delay(p, q)\ < 1. Intuitively, if A is functional, then any delay delay(p, q) associated with a 
pair {p, q) co-accessible with the (same) word w has to be recovered when reading w. If there are 
at least two different delays associated with (p, q), one of them cannot be recovered when reading 
the same word w, therefore A is not functional. The algorithm then consists first in computing all 
co-accessible pairs of states, and then all the triples (p, q, k) in a forward manner, where k represents 
some delay of {p, q). If two triples {p, q, k) and (p, q, k') with k ^ k' are reached, then A is not 
functional. Termination is obtained by a small witness property for non-functionality, which ensures 
that the triples need to be visited at most twice. A similar algorithm with another notion of delay is 
used for deciding functionality of DsumA-automata. 

3.2 Functionality of DsurriA-automata 

► Definition 4 (DsumA Delay). Let p,q e Q and d e Q. The rational d is a delay for (p, q) if A 
admits two runs p : qj ^ p, p' : qj ^ q on w £ I]*such that 



cannot be expressed by any functional ^-automaton. 



delay(p,p') =def 



DsumA(p) — Dsumx{p') 
AH 



= d 
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As for Sum-automata, at most one delay can be associated with co-accessible pairs of states of 
functional Dsum>, automata. 

► Lemma 5 (One Delay). Let A — {Q,qj, F,S,j) be afunctional Dsum \-automaton. For all 
pairs of states {p, q): If (p, q) is co-accessible, then {p, q) admits at most one delay. 

We now define an algorithm that checks whether a DsuiTlA-automaton is functional. In a first 
step, it computes all co-accessible pairs of states. Then it explores the set of accessible pairs of states 
in a forward manner and computes the delays associated with those pairs. If two different delays are 
associated with the same pair, or if a pair of final states with a non-zero delay is reached, it stops 
and returns that the automaton is not functional, otherwise it goes on until all co-accessible (and 
accessible) pairs have been visited and concludes that the automaton is functional. 



Algorithm 1: FunctionaHty test for DsurriA-automata. (DSumFunTest) 
Data: DsurriA-automaton A = {Q, qi,F, S, 7). 
Result: Boolean certifying whether A is functional, 
begin 

CoAcc ^ all co-accessible pairs of states; 
visited ^ ; de\ay{qi,qi) ^ 0; PUSH(S', {{qi,qi),Oj) ; 
while S^(d do 

((p,g),d)^P0P(5); 
it {p, q) ^ F'^ A d ^ then returns No; 
if {p, q) e visited then 
I if delay(p, q) ^ d then returns No 
else 

visited <— visited U {{p, q)}; 
delay(j<, q) d; 

foreach (p', q') e CoAcc s.t. 3a e S • {p, a,p') e 5 A{q, a, q') G (5 do 
PUSH(5, ((y, g'), lip, a,p') - l{q, a, q') + d)) ; 
returns Yes 



► Lemma 6. Let A = (Q, qi, F, S, 7) be a Dsuvn x-automaton. If A is not functional, there exists 
a word w ~ ctq . . . cr„ and two accepting runs p — qoao . . . qn, p' — <?oCTo ■ ■ ■ Qn such that 
DsumA(p) 7^ Dsuvr\\{p') and for all positions i < j in w, either (i) {pi,qi) 7^ {pj,qj) or (ii) 
de\ay{pi, p[) =/= de\ay{pj , p'j), where pi and p[ (resp. pj and p'^) denote the prefixes of the runs p 
and p' until position i ( resp. position j). 

We can now prove the correctness of Algorithm DSumFunTest. 

► Theorem 7. Given a Dsum x-automaton A, Algorithm DSumFunTest applied to A returns 
Yes iff a is functional and terminates within 0{\A\'^) steps. 

Sketch, full proof in Appendix. If DSumFunTest(y4) returns No, it is either because a pair of 
accepting states with non-null delay has been reached, which gives a counter-example to functional- 
ity, or it finds a pair of states with two different delays, so A is not functional by Lemma|5] 

Conversely, if A is non-functional, by Lemma |6] there exists a word w with two accepting runs 
having different values such that either no pair of states is repeated twice, in which case the algorithm 
can find a pair of final states with a non-null delay, or there is a pair of states that repeat twice (take 
the first that repeat) and has necessarily two different delays, in which case the algorithm will return 
No at line |6l if not before. A 
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3.3 Functionality of Ratio-automata 

Unlike Sum,Avg or DsurriA-automata, it is still open whether there exists a good notion of delay for 
Ratio-automata that would allow us to design an efficient algorithm to test functionality. However 
deciding functionality can be done by using a short witness property of non-functionality. 

► Lemma 8 (Pumping). Let Abe a Rabo-automaton with n states. A is not functional iff there 
exist a word w such that \w\ < 4n^ and two accepting runs p, p' on w such that Ratio(p) ^ 
Ratio(p')- 

Proof. We prove the existence of a short witness for non-functionality. The other direction is ob- 
vious. Let w be a word such that \w\ > and there exists two accepting runs pi, p2 on w such 
that Ratio(p) ^ Rat\o{p'). Since > 4ri^, there exist states p,q G Q,pf,qf G F and words 
wo,'Wi,W2, W3, W4 such that w = WQW1W2W3W4 and p, p' can be decomposed as follows: 

tUo|(''0,Cn) liJiKri.Ci) «'2|(''2,C2) IJJS I (rs ,£3) Ui4|(r4,C4) 

p : qi > p > p > p > p > pf 

I wa\{r'„,c[,) wi\(r[,c\) W2\{r'2,c'^) W3\{r'^,c'^) "141(1-4,04) 

p ■ qi > q > q > q > q > qj 

where r^, Ci denotes the sum of the rewards and the costs respectively on the subruns of p on Wi, and 
similarly for r'^,c^. 

By hypothesis we know that (X^Lo ^i) ' (Z^Lo ^0 ^ (SLo '^0 ' (J2t=o ^D- subsets 
X C {1, 2, 3}, we denote by wx the word wqw^u • ■ ■ Wi^w^ if X = {ii < ■ ■ ■ < ik}- For instance, 
^{1,2,3} = w, = W0W1W4 and w^-j = W0W4. Similarly, we denote by px, p'x the correspond- 
ing runs on wx- We will show that there exists X C {1, 2, 3} such that Ratio(px) 7^ Ratio(p^'). 
Suppose that for all X C {1, 2, 3}, we have Ratio(/C)j5(: ) = Ratio(yO^). We now show that it implies 
that Ratio(/9) = Ratio(/3'), which contradicts the hypothesis. For all X C {1, 2, 3}, we let: 

= ( E • ( E '^^) i?x = ( E • ( E 

iexu{o,4} iexu{o,4} iexu{o,4} iexu{o,4} 

By hypothesis, i{i.2,3} ^ ^^{1.2,3} and for all X C {1,2,3}, Lx = Rx- We now prove the 
following equalities: 

L{} + -^{1,2} + -^{1,3} + -^{2,3} - -^{1} - L{2} - i{3} = -^{1,2,3} 

R{} + ^^{1,2} + ^{1,3} + ^{2,3} - R{1} - R{2} - R{3} = ^{1,2,3} 

We only prove the equality with the L values as it is symmetric for the R values. For all i,jE 
{0, 4}, the subterm r^c^ occurs once in all expressions Lx, and 1 + 1 + 1 + 1 — 1 — 1 — 1 = 1. For 
all i, j G {1, 2, 3} such that i ^ j, the subterm ric'j appears once in ^{i.j} and once in i{i.2,3}- For 
all i e {1, 2, 3}, the subterm r^c'^ appears once in all Lx such that i G X, and there are exactly two 
such Lx that are added to the left of the equation, one that is substracted to the left, and one added 
to the right. For instance, the subterm ric'i appears in 2.3}, ^{1,2}: ^{1,3} ^"d It can be 

checked similarly that on the left of the equation, the coefficients for all other subterms are 1. 

Therefore, since by hypothesis we have Lx — Rx for all X C {1, 2, 3}, we get i{i_2.3} — 
R{i.2,3}, which is a contradiction. Thus there exists X C {1, 2, 3} such that Lx 7^ Rx- In other 
words, there exists X C {1,2,3} such that Rat\o{px) Ratio(p^). This shows that when a witness 
of non-functionality has length at least 4ri^, we can find a strictly smaller witness of functionality. 
This achieves to prove the lemma. M 

As a consequence, we can design a non-deterministic PSpace procedure that will check non- 
functionality by guessing runs of length at most 4n^, where n is the number of states: 

► Theorem 9. Functionality is decidable in PSpace /or RaWo-automata, and in NLogSpace ;/ 

the weights are encoded in unary. 
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► Remark. The pumping lemma states that if some Ratio-automaton with n states is not functional, 
there exists a witness of non-functionality whose length is bounded by 4n^, where n is the number 
of states. Such a property also holds for Dsum>,-automata (and is well-known for Sum and Avg- 
automata), but with the smaller bound 3n^. Those bounds are used to state the existence of two runs 
on the same word such that the same pair of states is repeated 3 or 4 times along the two runs. Then 
it is proved that one can remove some part in between two repetitions and get a smaller word with 
two different output values. However for Ratio-automata, three repetitions are not enough to be able 
to shorten non-functionality witnesses. For instance, consider the following two runs on the alphabet 
{a, b, c, d} and states {qi,p, q,Pf, <?/} where p/, qf are final (those two runs can easily be realized 
by some Ratio-automaton): 

a|(2,2) 61(2.1) c|(2.2) <i|(l,l) 

p ■ qi > p — —5' p — — > p > Pf 

I a|(l,2) b|(2-l) c|(l.l) <i|(2,l) 

p ■ qi > q — q — q > qj 



It is easy to verify that the word abed has two outputs given by p and p' while the words ad, abd and 

acd has one output. For 
on ad have both value 1. 



. . c ■ . ,u . a|(2,2) <i|(l,l) a|(l,2) d\i2S) 

acd has one output. For mstance, the two runs qi > p > pf and qi > q > qf 



1^ Decision Problems 

In this section we investigate several decision problems for functional F-automata as defined in [TOl, 
V € {Sum, Avg, DsurriA, Ratio}. Given two ^-automata A, B over E (and with the same discount 
factor when V = DsurriA) and a threshold i/ S Q, we define the following decision problems; 
Inclusion La < Lb holds if for all to G E+, < iB(™) 

Equivalence La = Lb holds if for all to G E+, La (to) = Lb (™) 

~ i^-Emptiness L^" / holds if there exists to G such that La(to) ~ {>, >} 

~ (/-Universality u ^ La holds if for all to G &om{A), La{w) ~ where ~G {>, >}. 
It is known that inclusion is undecidable for non-deterministic Sum-automata 1 18|, and therefore 
is also undecidable for Avg and Ratio-automata. To the best of our knowledge, it is open whether it 
is decidable for DsumA-automata. 

► Theorem 10. Let V G {Sum, Avg, DsurriA, Ratio} and let A, B be two V -automata such that 
B is functional. The inclusion problem La < Lb is decidable. IfV £ {Sum, Avg, Dsum^} then it 
is PSpace-C and if additionnaly B is deterministic, it is in PTime. 

Proof. LetF G {Sum, Avg, DsurriA}. In a first step, we test the inclusion of the domains dom( A) C 
dom(i?) (it is PSpace-C and in PTime if B is deterministic). Then we construct the product Ax B 

^11 / \ a\nA — nB , i i\ r -r-^ a\'<i-A , c i a,\'"-B , r. „i 

as follows: (j),q) > (P ,q ) G OaxB iff P > P £ OA and q > q G o_b. Then 

La ^ is iff there exists a path in Ax B from a pair of initial states to a pair of accepting states with 
strictly positive sum if y G {Sum, Avg}, and with strictly positive discounted sum if V — DsumA. 
This can be checked in PTime for all those three measures, with shortest path algorithms for Sum 
and Avg, and as a consequence of a result of [2} about single player discounted games, for Dsum^. 

Let V = Ratio. As for the other measures we first check inclusion of the domains. Then let 
Sa = {xi, . . . , Xn} and Sb — {yi, • ■ • , Um}- Let = (ri, . . . , r„) be the rewards associated with 
the transitions xi, . . . , x„ respectively. Similarly, let ca — (ci, . . . , c„) be the costs associated with 
xi, . . . ,Xn- The vectors rs and cb are defined similarly. 

We define the product Ax B of A and B similarly as before, except that the values of transitions 
are quadruples (ri, ci, r2, C2) of rewards and costs of A and B respectively. Let Saxb denotes the 
transitions of A x B. It is clear by construction of A x B that any transition t G Saxb can be 
associated with a unique pair of transitions in 5a x Sb, denoted by {aA{t), aB{t)). 
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Given a vector a = (ai, . . . , a„) G N" and a vector h — (61. ... , G N™, we say that the 
pair (a, h) fits A x _B if there exists w G and an accepting run pof Ax B onw such that for all 
transitions Xi G 5a (resp. G 5b), p visits the transitions t G 5axb such that = Xi (resp. 

ctB{t) = Uj) exactly ai times (resp. hj times). In other words, if rit denotes the number of times 
a transition t G is visited by p, we require that for all transitions Xi G 5a and all transitions 

Uj G (5_B, ai = I ^ £ (5AxB,aA(0 = a^i} and bj = Y^b^-t I ^ ^ 5Axs,aB(t) = We 

denote by F{A x B) the set of pairs (a, b) fitting A y. B. By using Parikh's theorem, it is easy to 
show that F{A X B) is a semi-linear set which can be effectively represented as the solutions of a 
system of Unear equations over natural numbers. We finally define the set F as follows: 

r = {(a, b) I (a, b) G F{A x B), a.r^ • (6.cb)^ > a.CA ■ [h-re)'^] 

where . denotes the pairwise multiplication, • the matrix multiplication, and the transposite. It 
is easy to check that F ^ iff La ^ Lb- The set F can be defined as the solutions over natural 
numbers of a system of equations in linear and quadratic forms (i.e. in which products of two 
variables are permitted). It is decidable whether such a system has a solution ll25lfT4i . 

There is no known complexity bound for solving quadratic equations, so the proof above does 
not give us a complexity bound for the inclusion problem of functional Ratio-automata. However, 
thanks to the functionality test, which is in PSpace for Ratio-automata, we can test equivalence 
of two functional Ratio-automata Ai and A2 in PSpace: first check in PSpace that dom(Ai) = 
dom(A2) and check that the union of Ai and A2 is functional. This algorithm can also be used for 
the other measures: 

► Theorem 11. Let V G {Sum, Avg, DsurriA, Ratio}. Equivalence of functional V-automata is 
PSpace-c. 

► Theorem 12. Let v Cz Q. The > v-emptiness (resp. > v-emptiness) problem is in PTime /or 
Sum-, Avg-, Ratio-, and Dsuvr\\-automata (resp. Sum-, Avg-, and RsAlo-automata). 

It is open how to decide > h' for Dsum^-automata. Dually: 

► Theorem 13. Let G Q. The > v-universality (resp. > v-universality) problem is PSpace-C 
for Sum-, Avg-, Ratio-, and Dsum\-automata (resp. Sum-, Avg-, and RsAlo- automata). 

{5 Realizability 

In this section, we consider the problem of quantitative language realizability. The realizability 
problem is better understood as a game between two players: the 'Player input' (the environment, 
also called Player /) and the 'Player output' (the controller, also called Player O). Player / (resp. 
Player O) controls the letters of a finite alphabet S/ (resp. So)- We assume that Eq n E/ = and 
that Eo contains a special symbol # whose role is to stop the game. We let E = Eo U E/. 

Formally, the realizability game is a turn-based game played on an arena defined by a weighted 
automatons! = (Q = Qo^Qi,qQ,F,5 — (5/U(5ci, 7), whose set of states is partitioned into two sets, 
(^o ^ Qo X Eo X Qi, (5/ C X E/ X Qq, and such that dom(A) C (E\{#})*#. Player O starts by 
giving an initial letter oq G Eo, Player / responds providing a letter io G E/, then Player O gives oi 
and Player / responds ii, and so on. Player O has also the power to stop the game at any turn with the 
distinguishing symbol #. In this case, the game results in a finite word (ooio)(oiii) . . . (ojij)# G 
E*, otherwise the outcome of the game is an infinite word (ooio)(oizi) ■ • • G E". 

The players play according to strategies. A strategy for Player O (resp. Player /) is a mapping 
Ao : (EoE/)* — ^ Eo (resp. A/ : Eo(E/Eo)* — ^ E/). The outcome of the strategies Ao,A/ 
is the word w = ooiooiii . . . denoted by outcome(Ao, A/) such that for all < j < Iwj (where 
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\w\ ~ +00 if w is infinite), Oj — Xo{oQio . . . ij-i) and ij — A(oo«o • • • Oj), and such that if # = Oj 
for some j, then w — ooio ■ ■ - Oj. We denote by Aq (resp. A/) the set of strategies for Player O 
(resp. Player /). 

A strategy Xq G Ao is winning for Player O if for all strategies A/ G A/, outcome(Ao, A/) 
is finite and Lyi(outcome(Ao, A/)) > 0. The quantitative language realizability problem for the 
weighted automaton A asks whether Player O has a winning strategy and in that case, we say that A 
is realizable. 

Our first result on reaUzability is negative: we show that it is undecidable for weighted functional 
Sum-, Avg-automata, and Ratio-automata. In particular, we show that the halting problem for de- 
terministic 2-counter Minsky machines can be reduced to the quantitative language realizability 
problem for (functional) Sum-automata (resp. Avg-automata). 

► Theorem 14. Let V e {Sum, Avg, Ratio}. The realizability problem for functional weighted 
V -automata is undecidable. 

The proof of Theorem [14] (in Appendix) relies on the use of a nondeterministic weighted auto- 
maton. Indeed, as stated in the next theorem, the quantitative language realizability problem is 
decidable for the four measures when the automaton is deterministic, in NP n coNP (see Appendix), 
though memoryfull strategies are necessary for winning those games. 

► Theorem 15. The quantitative language realizability problem for deterministic weighted V- 
automata, V G {Sum, Avg, DsurriA, Ratio}, is in NP n coNP. 

6 Determinization 

A ^-automaton A — {Q , qi , F, 5, -f) is determinizable if it is effectively equivalent to a deterministic 
y-automaton^. V-automata are not determinizable in general. For example, consider the right 
automaton on Fig. [1] Seen as a Sum, Avg or Dsum^-automaton for any A, it cannot be determinized, 
because there are infinitely many delays associated with the pair of states (p, q). Those delays can 
for instance be obtained by the family of words of the form a". 

We show that it can be decided whether a functional V-automaton is determinizable for V G 
{Sum, Avg, Dsum^}. However, it is still open for Ratio-automata, for which we do not have an 
adequate notion of delay. 

To ease notations, for all V-automaton A over an alphabet S, we assume that there exists a 
special ending symbol # G E such that any word w G dom(j4) is of the form w'^ with w' G 

Determinizability is already known to be decidable in PTime for functional Sum-automata lfT6ll "^. 
Determinizable functional Sum-automata are characterized by the so called twinning property, that 
has been introduced for finite word transducers [lU . Two states p, q are twinned if both p and q are 

co-accessible and for all words wi,W2 G S*, for all rti, 712, mi, 7712 G Z, if qj '"^^"S p "'^^"''> p 

wi\mi W2\m2 , , , ■ ■ ■ , , ■ 

and qj > q > q, then n2 — m2. In other words, the delays between the two runs cannot 

increase on the loop. If all pairs of states are twinned, then it is proved that the number of different 
accumulated delays on parallel runs is finite. The determinization for Sum-automata extends the 
classical determinization procedure of finite automata with delays. States are (partial) functions 
from states to delays. Clearly, a Sum-automaton A is determinizable iff the Avg-automaton A is 
determinizable. We can even use exactly the same determinization procedure as for Sum-automata. 



' With the existence of an ending symbol, the notion of determinizability corresponds to the notion of subsequential- 
izability |11|. 

See I17IIT51 for determinizability results on more general classes of Sum-automata. 
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► Theorem 16 ( 11 61 ). // is decidable in PTime whether afunctional Sum or AvQ-automaton is 
determinizable. 

We now explain the determinization procedure for DsuiTlA-automata. 

► Definition 17. We say that two states p, q are twinned if both p and q are co-accessible and for 
all words Wi,W2 G 2j , for all runs pi : qj — > p, p2 : p — > p, Pi : qi — > q, P2 q — > q, we 
have delay(pi,p'i) = delay(pip2, piP2)- 

A DsurriA-automaton A satisfies the twinning property if all pairs of states are twinned. We 
show that the twinning property is a decidable characterization of determinizable functional DsuitIa- 
automata. First, we prove that it is decidable in PSpace: 

► Lemma 18. Is it decidable in PSpace whether a Dsum x-automaton satisfies the twinning 
property. 

We denote by T> the set of possible delays between two runs of A, i.e. T> is the set of delays 
delay(p, p') for all runs p, p' on the same input word, such that the last states of p and p' are both 
co-accessible. 

► Lemma 19. if the twinning property holds, then T) is finite of size at most . 

Proof. As delays must be identical on parallel loops, any delay can be obtained with some pair of 
runs of length \Q\'^ at most (on longer pairs of runs, there must exist a parallel loop with identical 
delays that can be removed without affecting the value of the global delay of both runs, see Lemma 
l24lof the Appendix). < 

Determinization Assume that the twinning property holds. We define a determinization procedure 
that constructs from a functional DsurriA-automaton A = {Q, qj, F, S, 7) a deterministic DsurriA- 
automaton Ad = {Qd, fd, Fd,Sd,'jd)- Wlog we assume that all states are co-accessible (otherwise 
we can remove non co-accessible states in linear time). We define Q' — V'^ (which is finite by 
Lemma[T9]l, the set of partial functions from states Q to delays. We let fj-.qji-^O and F' is defined 
as {/ G Q' I dom(/) n F ^ 0}. Then, given partial functions /, /' G Q' and a symbol a G S, we 
let: 

7'(/,a,/') = miii{-l^+-f{q,a,q')\qedom{f)Aiq,a,q')eS} 

(/, a, /') G S' iff for all q' G dom(/') there exists q G dom(/) such that {q, a, q') G S and 

/'(?') = ^ +7(9, «, 9') -7'(/,«,/') 

Let Qd C Q' be the accessible states of A' := {Q' , fj,F', 5', 7')- We define Ad = (Qd, fd, 6d, "fd) 
as the restriction of A' to the accessible states. 

► Lemma 20. If the twinning property holds. Ad and A are equivalent. Ad is deterministic and 
has OdEjl'^l ) states. 

The proof is based on the following lemma: 

► Lemma 21. Let f G Qd be state of Ad accessible by a run pd on some word w G S*. Then 

dom{f) is the set of states q such that there exists a run on w reaching q. Moreover, if q Cz 

dom{f) and p is a run on w reaching q, then f{q) — max{delay(/9, p') \ p' is a run of A on w} — 

DsumA(p) - DsumA(pd) , „ , . .p, tc\\ c ■ fA 1 
-r-, and \JS\im\[pd) = Ta\n\\jsum\(t,) \ ^is a run of A on w\. 

\\w\ 

If the twinning property does not hold, we show that V is infinite and that A cannot be determin- 
ized. Therefore we get the following theorem: 

► Theorem 22. Afunctional Ds[im\-automaton is determinizable iff it satisfies the twinning prop- 
erty. Therefore determinizability is decidable in PSpace for functional Dsum x-automata. 



Quantitative Languages Defined by Functionai Automata 



References 

1 Benjamin Aminof, Orna Kupferman, and Robby Lampert. Rigorous approximated determinization 
of weighted automata. In LICS, pages 345-354, 2011. 

2 D Andersson. An improved algorithm for discounted payoff games. In ESSLLI Student Session, 
pages 91-98, 2006. 

3 Beal, Carton, Prieur, and Sakarovitch. Squaring transducers: An efficient procedure for deciding 
functionality and sequentiality. TCS: Theoretical Computer Science, 292, 2003. 

4 Jean Berstel and Christophe Reutenauer. Rational Series and Their Languages. Number 12 in 
EATCS Monographs on Theoretical Computer Science. Springer- Verlag, 1988. 

5 Henrik Bjorklund and Sergei Vorobyov. A combinatorial strongly subexponential strategy improve- 
ment algorithm for mean payoff games. Discrete Appl. Math., 155:210-229, 2007. 

6 Meera Blattner and Tom Head. Single-valued a-transducers. JCSS, 15(3):310-327, 1977. 

7 Roderick Bloem, Karin Greimel, Thomas A. Henzinger, and Barbara Jobstmann. Synthesizing 
robust systems. In FMCAD, pages 85-92. IEEE, 2009. 

8 Udi Boker, Krishnendu Chatterjee, Thomas A. Henzinger, and Orna Kupferman. Temporal spe- 
cifications with accumulative values. In LICS, pages 43-52, 2011. 

9 Udi Boker and Thomas A. Henzinger. Determinizing discounted-sum automata. In CSL, pages 
82-96, 2011. 

10 Krishnendu Chatterjee, Laurent Doyen, and Thomas A. Henzinger. Quantitative languages. ACM 
Trans. Comput. Log, 11(4), 2010. 

1 1 Christian Choffrut. Une caracterisation des fonctions sequentielles et des fonctions sous- 
sequentielles en tant que relations rationnelles. Theor Comput. Sci., 5{3):325-337, 1977. 

1 2 Luca de Alfaro, Marco Faella, Thomas A. Henzinger, Rupak Majumdar, and Marielle Stoelinga. 
Model checking discounted temporal properties. Theor. Comput. ScL, 345(1): 139-170, 2005. 

1 3 Manfred Droste and George Rahonis. Weighted automata and weighted logics with discounting. In 
CIAA, pages 73-84, 2007. 

14 Fritz Grunewald and Dan Segal. On the integer solutions of quadratic equations. Journal fiir die 
reine und angewandte Mathematik, 569:13^5, 2004. 

15 Daniel Kirsten. A burnside approach to the termination of mohri's algorithm for polynomially 
ambiguous min-plus-automata. /TA, 42(3):553-581, 2008. 

1 6 Daniel Kirsten and Ina Maurer. On the determinization of weighted automata. Journal of Automata, 
Languages and Combinatorics, 10(2/3):287-312, 2005. 

1 7 Ines Klimann, Sylvain Lombardy, Jean Mairesse, and Christophe Prieur. Deciding unambiguity and 
sequentiality from a finitely ambiguous max-plus automaton. Theor. Comput. Sci., 327(3):349-373, 
2004. 

1 8 Daniel Krob. The equality problem for rational series with multiplicities in the tropical semiring is 
undecidable. Int. Journal of Algebra and Computation, 4(3):405^25, 1994. 

19 Marvin L. Minsky. Computation: Finite and Infinite Machines. Prentice-Hall, 1967. 

20 Mehryar Mohri. Weighted automata algorithms. Handbook of Weighted Automata, pages 213-254, 
2009. 

21 A. Pnueli and R. Rosner. On the synthesis of a reactive module. In ACM Symposium on Principles 
of Programming Languages (POPL). ACM, 1989. 

22 Marcel Paul Schiitzenberger. Sur les relations rationnelles. In Automata Theory and Formal Lan- 
guages, volume 33 of LNCS, pages 209-213, 1975. 

23 Wolfgang Thomas. Church's problem and a tour through automata theory. In Pillars of Computer 
Science, pages 635-655, 2008. 

24 Andreas Weber and Reinhard Klemm. Economy of description for single- valued transducers. Inf. 
Comput., 118(2):327-340, 1995. 

25 Karianto Wong, Aloys Krieg, and Wolfgang Thomas. On intersection problems for polynomially 
generated sets. In ICALP, volume 4052 of LNCS, pages 516-527. Springer, 2006. 



E. Filiot, R. Gentilini, J.-F. Raskin 



Quantitative Languages and Functionality 
A.1 Functionality and Unambiguity 

► Lemma 23. Let V G {Sum, Avg, DsurriA, Ratio}. For all functional V-automaton with n states 
we can construct an equivalent unambiguous V-automaton with 0(n.2") states. 

Proof. Our proof is independent on the measure. Let A = {Q,qj, F,S,j) be a functional V- 
automaton. We order the transitions of 5 by a total order denoted by <5. We construct an equivalent 
unambiguous automaton A' = {Q', q'j, F', 6', 7'), where: 
. Q' = Qx2Q; 

- g,:-(g/,0); 

. F' ^ F X {F CQ \ FnP = 0}; 
. 7' : ((p,P),a,b',P'))^7(P,a,P'); 

Before defining S' formally, let us explain intuitively the semantics of the states in Q'. The 
automaton A' will guess a run of A on first state component (called the current run). A pair {p, P) 
represents the state p of current run in the original automaton A while P represents the states reached 
by all the runs that are greater than the current run (for the order <s lexigraphically extended to runs). 
At the end of the word, the run is accepting iff p is accepting and there is no accepting state in P. In 
other words, a run of A' on a word w is accepting iff the run it defines on the first component is the 
smallest accepting run of A on w. 

When a new letter a G E is read. A' guesses a transition from p to some state p', and goes to the 
state {p' , Sp U Sp,a.p'), where Sp are the successor states of of P by (5 on the input a, and Sp^a,p' 
are all the states reached from p by a transition on a bigger than (p, q, p'). 

Formally, ((p, P), a, (p', P')) e 5' iff 

- {P,a,p') e S ; 

- P' = {q' \3qeP, {q, a, q') e 5} U {p" \ (p, a,p") G <5 A (p, a,p') <s (p, a,p")}. 

It is clear by construction that A and A' defines the same domain. As A is functional, they also 
define the same function, because the value of a word is equal to the value of any run on it, and in 
particular to the value of the smallest run. -4 



fB^ Functionality 
B.1 Proof of LemmalU 

Proof. Consider a co-accessible pair of states (p, q). Assume that (p, q) admits two delays di,d2. 
We show that if A is functional, then di — d2. Let pi : qo ^ p, p'l : qo q (resp. p2 ■ qo p, 
p'2 ■ qo^ q) be two runs witnessing the delay di (resp. 1^2), i.e.: 

Dsumx{pi) - DsumA(/oi) , Dsumx{p2) - Dsumx{p'2) , 

r\ \ — "1; Tl i — "2 

Since (p, q) is co-accessible, there exists a word u and two runs p^ : p f £ F, p'^ : q f £ F. 
Moreover, the hypothesis of functionality on A implies: 

DsurriAlpips) - DsumA(pip3) = (1) 



DsumA(p2P3) " DsumA(p2/03) = (2) 
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Let ?;i,o ■ ■ • vi^m (resp. v[ q . . . 1^3,0 • • • ^^3,;, ^'3^0 • • • "3 ;) '^^e sequence of weights occuring 
along pi (resp. p[, p^, p'^), where m — — 1 and / = |u| — 1. 
Then, Equation [T] implies: 

m I m I 

i=0 1=0 j=0 i=0 

Let V2.Q ■ ■ ■ V2.n (resp. f 2 • ■ ■ ^^2 «) be the sequence of weights occuring along p2 (resp. P2), where 
n = \w2 1 — I. 

Then, Equation |2] implies: 

n / n I 

1=0 i=0 i=0 i=0 

Equations |3] and|4]yield: 

mm / / 

(J] v^,y - J2 = A™+i(5^ - 5] t;3,,:A0 (5) 

n n II 

(Y A' - E AO = A"+i(^ ^,A' - J2 ^3.'^') (6) 

i=0 i=0 i=0 i=0 

Dividing both the members of Equation|5]by A'"+^ and both the members of Equation|6]by A"+^, 
and finally subtracting the obtained results, we get our thesis i.e. 

D5umA(pi) - Dsumx{p[) _ DsumA(p2) - DsutriACpa) 



B.2 Proof of Lemma m 

We first prove the following key result: 

► Lemma 24. Let A = (Q, qi, F, S, 7) be a Dsum x-automaton. Let wi, W2, W3 G S* such that 
there exist p, p' ,q,q' G Q and the following runs: 

Wi W2 

Pi: qi — >p p2:p — >p Ps ■ P — > Q 

Pi-qi — >p P2-P — >p P3-P — > q 

and such that delay {pi, p[) = delay(pi/92, PiP^- ^/zm delay(pip2P3, P1/32P3) = delay(/9ip3, p'^^pg). 
Proof. By hypothesis, we have the following equality: 

DsumA(/Oi) + Al"'ilDsumA(p2) - DsumA(|o'i) - A'^'iI DsurriAl/Oa) _ DsumA(/9i) - Dsumxjp'^) 

\\W1\ + \W2\ \\wi\ 

(7) 

which implies: 

DsumA(/9i)+Al"'ilDsumA(p2)-DsumA(p'i)-Al"'ilDsumA(p2) = A'"'^! (DsumA(pi)-DsumA(p2)) 
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(8) 



By definition of the delays, we have: 
delay(pip2P3,piP2P3) = 

DsumA(/5i) + Al"'iDsumA(p2) + AI"'i"'=' DsurriAlpa) - DsumA(p'i) - A'""! DsumA(/92) - AI'"i'"=^I DsumA(p3) 



(9) 



Thanks to Equation|8] it can be simpHfied into: 

Al"'2l(DsumA(/5i) - DsurPAK)) + Al"'i"'2lDsumA(p3) - AI"'!"'^! DsumA(p3) 



delay(pip2P3,p'iP2P3) 



(10) 



We can now simplify this expression by A'^'^ ' and we get: 



DsumA(pi) - DsumA(p;) + Al'"^lDsumA(p3) " A'"-^' DsumA(p^) 
de\By{pip2P3, P1P2P3) = ^|^^^3| (11) 

which exactly means: de\ay{pip2P3, P1P2P3) — de\ ay {pi p3, p[p'^). 

■4 

Lemma|6l Let w e dom(A) such that > 1. Clearly, there exist two runs p, p' on w such 

that DsumA(p) ^ DsumA(p')- Moreover if p and p' can be decomposed so that the premises of 
Lemma l24l are satisfied, then we can find a strictly shorter word with two runs on it which have 
different delays. We can repeat this operation until the goals of Lemma|6]are satisfied. M 

B.3 Proof of Theorem |7] 

Proof. We start to prove that A is not functional iff DSumFunTest(A) returns No. 

(-4=) The following invariant holds overall the execution of the algorithm: If the stack S contains 

the pair {{p, q),d), then (p, q) is co-accessible and A admits two runs p : qi ^ p, p' : qi ^ q such 

DsumA(p) — DsurriAf/ci) , ^, . , . , . , . 

that — = a. This can be proved by a simple inductive argument on the number 

A'™l 

of iterations of the while loop at LineQ] Suppose that DSumFunTest(A) returns No. There are two 
cases to consider. If the pair {{p,q) G F^,d 7^ 0) is popped from the stack, then it witnesses the 
existence of two accepting runs p : qi ^ p, p' : qi ^ q in A for which DsumA(/o) — DsumA(jo') ^ 
0. Thus, A is not functional. In the second case, the pair {{p, q), d) popped from the stack witnesses 
that A admits two delays for the co-accessible pair of states {p, q). By Lemma|5] this implies that A 
is not functional. 

(^) Let j4 be a non functional DsuiTlA-automaton. By Lemma|6] there exists a word w such that 
A admits two runs p : qj ^ qj F, p' : qj ^ q'j E F on w such that DsumA(p) 7^ DsumA(p')- 
Suppose that for all positions i < j, {pi, qi) ^ {pj, qj). In that case DSumFunTest(A) will output 
No at Line|5](if not before). Otherwise let 12 be the least position on the two runs p, p' such that there 
exists ii < 12 such that p (resp. p') reach the state p (resp. q) at positions ii and 12- By condition (ii) 
of Lemma|6] the delays are different at ii and 12 and therefore DSumFunTest(A) will determine 
that A is not functional at Line|6] after processing p, p' upon position 12 (if not before). 

This algorithm terminates as any pair of states is visited at most twice. It is well-known that co- 
accessible states of a finite automaton can be computed in linear time. We can apply this procedure 
on the product of A with itself to compute the co-accessible pairs of states in quadratic time. -4 
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B.4 Proof of Theorem M 

Proof. We give an non-deterministic CoPSpace (and hence PSpace) algorithm to test non-functionahty. 
By the pumping lemma, if a ratio-automaton with n states is not functional, there exists a word of 
length at most with two different values. We use the following non-deterministic iterative al- 
gorithm: non-deterministically choose two transitions in parallel on the same input letter and count 
the current length (up to 4n^), and compute the current respective rewards and costs of the two 
current runs. Non-deterministically choose to stop before the length exceeds 4n^ and check that 
the reached states are accepting and that the respective ratio of the two chosen runs are different. 
We therefore need to store the two current states, reward sum and cost sum, which are bounded by 
An^Mr and An'^Mc, where Mr and Mc are the maximal reward and cost (in absolute value). Those 
sums are represented in pspace, and in nlogspace if the weights are unary encoded. M 



JC Decision Problems 
C.1 Proof of Theorem [12] 

Proof. For DsuitIa automata, we show that L^'^ ^ iff Player has a strategy to ensure a 
play from vq with discounted sum greater than v in the one player (infinite) DsuitIa game F = 
{V,E,w, (t/o,'^^i)), where: 

. £: = X (EUC) X n ({(p,a,p') I (p,a,p') £ ^} U {(p,C,p) |p G i^}), where C ^ S is a 
fresh symbol 

H For each e = {p,a,p') E E: If (p, a, p') G 5, then w{e) — j{p, a, p'), else w{e) — 0. 
Once proved the above equivalence, our complexity bound follows easily, since checking wether 
7^ ^ reduces to solving a 1 player DsuitIa game (that is in PTime 12|). 

{^)lfL^ ^ 0, then A admits an accepting run r : (?o = ro r„ G _F suchthat DsumA(7(r) > 
u. By construction, F admits an (infinite) path p with a positive discounted sum, i.e. Player has a 
(memoryless) strategy to win the one-player discounted sum game F. 

(<^=) S uppose that Player has a strategy to win the one-player discounted sum game F. Let p 
be an infinite path on F consistent with a winning strategy for player 0. Then DsumA(r) > 0. Let 
W be the maximum absolute weight in F. For each prefix of length z of r we have: 

W 

DsumA(ri) + > DsumA(r) 

1 — A 

Dsum xir i) >Dsumx{r) - -^—^ (12) 

Since DsumA('r) > j/, there exists i* such that DsumA(r) > that implies DsumA(ri.) > v. 

1 — A 

By construction, each path in F can be extended to reach a node in F. Let = Tq . . . e be 
such a continuation of . By Equation[T2l our choice of i* guarantees that DsumA(r^) > v- Since 
A is functional, r' witnesses the existence of a word w such that La{w) > v. 

For Sum automata, let A be a Sum-automaton. L'^ ^ iff ^ admits a path to a final state 
whose sum of the weights is ^ v. This can be easily checked in PTime, using e.g. a shortest path 
algorithm (once the edges have been reversed). 

For Avg-automata, let A be an Avg-automaton. We can assume v = since the ^ i/-emptiness 
problem for Avg-automata reduces to the ^ 0-emptiness problem for Avg-automata, by simply 
reweighting the input automaton [51. L"^ 7^ iff ^ admits a path to a final state whose sum of the 
weights is ~ 0, that can be easily checked in PTime. 
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Til 

Finally, let A be a Ratio-automaton, let i/ = — . We consider the Sum automaton A', where 

n 

each edge of A having reward r and cost c is replaced by an edge of weight rn — cm. It can be easily 
proved that L'X" ^ iff L'^Y + 0. 



C.2 Proof of Theorem [l^ 

Proof. Let A be a ^-automaton, V G {Sum, Avg, DsurriA} and consider the > i^-universality 
(resp. > i^-universality) problem for ^-automata. We check wether A admits an accepting run 
with Viciij)) < V. This can be done in PTime for V E {Sum— , Avg— , Ratio, DsumA — } (resp. 
V £ {Sum— , Avg— , Ratio}), with a procedure similar to the one applied in the proof of Theorem 



fb Realizability 

D.1 Proof of Theorem [14] 

Proof. A 2-counter machine M consists of a finite set of control states S, an initial state sj G S, 
a final state sp G Q, a set C of counters (|C| = 2) and a finite set Sj^j of instructions manipulating 
two integer- valued counters. Instructions are of the form 
s : c := c + 1 goto s' 

s : if c = then goto s' else c := c — 1 goto s". 

Formally, instructions are tuples (s, a, c, s') where s,s' G S are source and target states respectively, 
the action a G {inc, dec, 0?} applies to the counter c G C. We assume that M is deterministic: for 
every state s G S*, either there is exactly one instruction (s, a, •, •) G 5m and a — inc, or there are 
two instructions (s, dec, c, ■), (s, 0?, c, •) G 6m. 

A configuration of M is a pair {s, v) where s G 5 and w : C — > N is a valuation of the counters. 
An accepting run of M is a finite sequence tt = {so,vq)So{si,vi)6i . . . 
Sn-iisn,Vn) whcrc Si — {si, ai, Ci, Si+i) G 5m are instructions and {si,Vi) are configurations 
of M such that sq = s/, uo(c) = for all c G C, s„ = sj?, and for all < i < n, we have 
7Ji+i(c) = Vi{c) for c 7^ Cj, and (a) if a = inc, then Vi+i{ci) = Viici) + 1 (5) if a = dec, 
then Vi{ci) ^ and Vi^i{ci) — Vi{ci) — 1, and (c) if a = 0?, then Wi+i(ci) = Vi(ci) = 0. The 
corresponding run trace of tt is the sequence of instructions tt = SqSi . . . (5„-i. The halting prob- 
lem is to decide, given a 2-counter machine M, whether M has an accepting run. This problem is 
undecidable lfT9l . 

Given a 2-counters (deterministic) machine M, we construct a functional weighted functional 
Sum-automaton A ~ {Q,qo,S,'y) (resp. Avg-automata), where Q = Qo U Qi, S — So U S/ 
and (5 C Q X S X Q such that M halts if and only if L{A) is realizable. In particular, Eq ~ 5m 
and a strategy tt G Aq for Player O is winning if and only if for each A/ G A/, the projection of 
outcome(7r, 72) onto is an accepting run of M. The alphabet S/ for Player / is the set of letters 
S/ = {go} U (Ui=i 2{c/!eflfC/-i-, cheatCi-}) U (Uo<j<|S| {cheatR:sj}). The role of Player / is that 
of observing the play of Player O and detecting whether he faithfully simulates M, or he cheats. In 
details, if Player O cheats by declaring the i-th counter equal to when it is not (positive cheat), 
then Player / can use the action cheatCi+, i G {1, 2}, to force all the runs but one (with weight 
< 0) to die. Similarly, if Player O cheats by decrementing a counter with value zero (negative cheat) 
or on the structural properties of a run of M, then Player / can win by playing the corresponding 
observing action : cheatCi-, for negative cheats on counter i E {1, 2}, or cheatR:sj for a cheat on 
the run through M detected at state sj. 

The automaton A consists of a nondeterministic initial choice between different gadgets, de- 
scribed below. Each gadget checks one of the properties of the sequence of actions provided by 
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Figurs 2 Gadget to check positive cheats 



Figurs 3 Gadget to check negative cheats 



Player O, and verify whether Player O simulates faithfully M or he eventually cheats. Due to the 
initial nondeterministic choice, each final state (in one of the gadget) is accessible throughout the 
evolution of the play and Player O has to ensure that all the properties checked in the gadgets are 
fulfilled. Otherwise, Player / will have the ability to kill all the runs but one, and to ensure that the 
only surviving run (in the appropriate gadget) reaches the final state with weight < 0. 

In particular, Figure |2] represents the gadget to check a positive cheat on counter i, i G {1, 2}. 
Player / observes the inverted value of the counter i throughout the path on M simulated by Player O. 
Whenever Player O declares that counter i is equal to 0, Player / can use the action cheatCi+ to kill 
all the runs in A but the one within the observing gadget. The evolution of such a run up to cheatCi+ 
will have a negative value (corresponding to the inverted value of the observed counter) if Player O 
was cheating. Hence, as soon as Player O playes jj it will end in a final state with weight < 0. 
Symmetrically, the gadget for checking negative cheats (represented in Figure O uses the weights 
on the edges to store the value of the observed counter If Player O cheats decrementing counter i 
when its value is 0, Player / can use the action cheatCi- to kill all the runs but the one (with negative 
value) in the gadget observing negative cheats. 

Finally, Player / can use the gadgets in Figures |5]-|6] to detect any structural cheat committed by 
Player O. If Player O initially provides an action different from (so,_7_, Player / can punish 
him by playing action cheatR:sO. Similarly, if Player O provides two actions that do not induce a 
(sub)-path in M, Player / can punish him within the gadget in Figure |6] 

The automaton A will contain a gadget to observe positive/negative cheats for each counter 
i £ {1, 2}, a gadget to observe a structural cheat for each state s £ S that can be traversed by a 
path in M, and a neutral gadget (represented in Figure |4|l, where Player / simply observes the run 
provided by Player O and let such a run to reach a final state as soon as Player O provides an action 
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1 Figure 4 Neutral gadget. 
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[ Figure 5 Gadget to check that Player 1 plays {so,-,-, ■) at the beginning. 



simulating a step toward the halting state of M. The proof is concluded by showing that M halts iff 
Player O has a strategy to win the realizability game on A. Namely, we show that Player O wins the 
realizability game iff he provides a word tt which corresponds to an accepting run of M (and then 
stop the game). 

(=^>) Suppose that AI halts. Let tt be the run of M leading to the halting state, and consider Ao(7r) G 
Ao, where Ao(7i') denotes the strategy for Player O induced by tt, in which PlayerO provides the 
word TT and then stop the game. Let A/ G A/. There are two cases to consider. 

1 . In the first case. A/ does not provide any action in: 

( {cheatCi+,cheatCi-}) U { {cheatR:sj}) 

i=l,2 0<i<|S| 

Then, the only run to a final state in A is the one within the neutral gadget, having weight 1. 

2. In the second case, 7/ contains an action in (lJi=i 2{c/!eflfC/+, c/ieafC/-}). Let a be the first 
action in (Ui=i 2{c/^eflfC/+, cheatCi-}) on A/. There is only one gadget allowing a run contain- 
ing a. Since tt is faithfully simulating M, such a run leads to a final state in the corresponding 
gadget with value > 0. 

Note that A/ can not contain an action a G (Uo<j<|s| {cheatRisj}). In fact. Player / can never play 
cheatR:sj, since Player O does not commit any structural cheat on the run tt. Hence, we conclude 
thatVA/ G A/(L^(outcome(Ao(7r), A/) > 0). 




I Figure 6 Gadget to check cheats along the run. 
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(<S=) Suppose that the strategy Xq G Ao is such that VA/ £ A7(Lyi(outcome(Ao, A/) > 0). By 
construction of A, Xq allows Player 1 to survive in the gadgets for detecting positive, negative or 
structural cheats if and only if the projection of the outcome onto So is a faithful simulation of a run 
in AI. If Player / can not use an action in (lJi=i 2{c/ieflfC/+, cheatCi-}) U {{J^^j^^g^lcheatRjsj}) 
to win (using the gadget targeted to check the corresponding cheat), the only remaining strategy for 
Player / is playing indefinitely -^cheat. In that case. Player O wins only if he eventually provides 
an action simulating a step leading to an halting state in M (and then stop the game). Thus, our 
hypothesis entail that Ao consists in providing a run for M that leads to a final state, witnessing that 
M halts. 

D.2 Proof of Theorem [15] 

Proof. We first consider the case of deterministic Sum-automata. Let A = {Q — Qo^Qi, Qi, F,S ~ 
SjUSo, 7) be a deterministic Sum-automaton. Without lost of generality, we assume that A contains 
only one accepting state denoted by / which is absorbing. Then we consider A as a finite state game 
arena and compute the set of states S C Q from which player 1 can force a visit to the accepting 
state /. Note that from any state s in S, player 1 has a strategy to force a visit to / within n steps, 
where n = \Q\. Note also that by determinacy, the complement of this set is the set of states of A 
from which player 2 has a strategy to prevent a visit to /. Clearly, player 1 has to avoid the states 
in Q \ 5* at all cost and so they can be removed from A. Let A' be A where we have kept only the 
states in S. 

Now, we construct from A' a finite tree as follows. We unfold A' and stop a branch at a node 
when: 

H it is labeled with / and the sum of the weights on the branch up to the node is equal to c > 0, 
H it is labeled by a state q that already appears on the branch from the root to the node. We call the 

node where q already appears the ancestor of the leaf. 
Let us note L the set of leafs of this finite tree. We then partition the leafs of this tree into Li, the set 
of leafs that are good for player 1 and L2, the set of leafs that are good for player 2. Li contains: 
H (Ci ) the leafs that are annotated with / and for which the sum of weights is strictly positive and 
H (C2) the leafs labeled with a repeating state and for which the sum of weights from the root to 

the leaf is strictly larger than the sum of weights from the root to the ancestor. 
L2 = Q \ Li sae the leafs that are good for player 2. Now, consider the game played on this finite 
tree where player 1 wants to reach Li and player 2 wants to reach L2- The winner in this game can 
be determined by backward induction. We claim (and prove) below that player 1 win in this finite 
game tree iff he wins the original game. 

Assume that player 1 wins the finite game tree. We show how to construct a winning strategy in 
the original game. The strategy is built as follows. In the original game, player 1 plays as in the final 
tree up to the point where he reaches a leaf (in Li). If the leaf is of sort defined in Ci above then 
we know that player 1 has won the original game. Otherwise, we know that the sum now is strictly 
greater than the sum up to the ancestor of the leaf that we have reached. Then player 1 continues to 
play as prescribed by its winning strategy in the tree from the ancestor Continuing like that, each 
time that the game arrives at a leaf, the sum of weights has strictly increased from the last visit to that 
leaf. As a consequence, after a finite amount of time, the sum will be strictly larger than n ■ \ — W\ 
where — is the smallest negative weight in A' . From that point, player 1 can use his strategy that 
forces the state / and reach it with a sum that is strictly positive (this is because he can force / within 
n steps). 

Now assume that player 2 wins the finite game tree. We show how to construct a winning 
strategy in the original game. The strategy simply follows the strategy of player 2 in the finite tree 
by applying the strategy from the ancestor when reaching a leaf. As only leaf in L2 are reached when 
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playing that way, we know that the sum on successive visits to repeating states is non-increasing. As 
a consequence, as player 1 cannot force a visit to a node labeled with / and a strictly positive sum 
in the finite game tree, we know that this will not append in the original game neither when player 2 
plays its strategy. 

This proof clearly establishes that the problem belongs to NP n coNP as we can guess for the 
winning player one edge per states and verifies in polynomial time that this leads to a winning 
strategy in the original game. Nevertheless, note that player 1 needs memory to win in the original 
game as he has to verify that he has reached a sufficiently high sum before applying the strategy that 
forces the visit to /. 

As for the previous results Avg games can be reduced easily to Sum games, and as for the 
questions about thresholds. Ratio games can be reduced to Avg games. 

We now turn to the case of DsuitIa. The solution for DsuitIa is obtained by first removing from 
A all states from which player 1 cannot force a visit to /. As above, we note the game where those 
states have been removed by A' . Then, we consider A' as an (infinite) discounted sum game where 
player 1 tries to maximize the value of the discounted sum while player 2 tries to minimize this 
value. Let v denotes the value of the initial state qi in that game. We claim that player 1 wins the 
initial game iff the value v in qj is strictly positive. Indeed, if player 1 has a winning strategy in the 
original game, i.e. a strategy to force the game into / with strictly positive discounted sum, then by 
playing this strategy in the discounted sum game, the infinite discounted sum will be equal to the 
discounted sum up to / as from there only the self loop on / is crossed and its weight is equal to 
0. Now assume that player 1 has a strategy that force a value v > in the discounted sum game. 
Then by playing that strategy for i steps in the original game with i large enough to make sure that 
X^W + ■ ■ ■ + X^'^^W is small enough, he will be able to switch to its strategy that forces / after at 
most n steps and ensure to reach / with a strictly positive discounted sum. As infinite discounted 
sum games are in NP n coNP 121 and since our reduction is polynomial, we also get that finite 
reachability discounted sum games are in NP n coNP. 



|E Determinization 
E.1 Proof of Lemma [181 

We prove the following short witness property for the twinning property: 

► Lemma 25. Let A be a Dsum x-autot7iaton. If A does not satisfy the twinning property, there 
exist two words wi,W2 G S* such that \ wi\ < 2\Q\'^ and \ w2\ < 2|(5p, two states p, q € Q such that 
p and q are both co-accessible, and runs pi : qi — p, p2 '■ p — ^ p, p\ '■ qi q, p'2 '■ q — ^ q, 
such that delay {pi, p[) ^ delay(pi/92, pi/02). 

Proof. Suppose that |u>2| > 2|(5p (the case |wi| > 2|Qp is proved exactly the same way) 
and that W1W2 witnesses that the twinning property does not hold by the decomposition into runs 
pi, P2, p'l , P2 as in the premisses of the lemma. We will show that we can shorten the runs pi , p[ and 
still get a witness that the twinning property does not hold. 

Since \w2\ > 2|Qp, there is a pair of states {p' , q') that repeat three times along the two parallel 
runs p2 and p^, i.e. W2 can be decomposed as w'iW2w't;w'j^ and p2 and p'2 can be decomposed as 
Tir2'r3r/i and r'T^r'2r'^r'ji^ respectively, where: 

tu' tu' w' U)' 

ri : p — >• p r2 : p — > p : p — > p : p — p 
r-^-.q — > q r2 : q — > q r^:q — > q r^:p — > q 

Note that ri, and r4, may be empty (in this case p = p' and q = q'), but r2, ra, Tj, rg are 
assumed to be non-empty. 
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Now, there are two cases: delay(piri, p'^^r'j^) / delay(pirir2, pi»''i?'2) '^^'^ ™ '^^at case the word 
wiw'iW2 is a witness that the twinning property does not hold, and \wiw'iw'2\ < \wiW2\- In the 
second case, we have de\ay{piri, p[r'i) = delay(pirir2, p^r'j^rj), but in that case, we can apply 
Lemma l24l and we get delavfoi ri r^rA. p'jr'ir'or'^) ~ delay(pi/92, ^'1^2)- Therefore delay(pi, pj) ^ 
delay(pirir3r4, p'ir[r'^r'^) and wiw'iw'^^w'^^ is a shorter witness that the twinning property does not 
hold. 

We can iterate this reasoning until we find a witness whose size satisfy the premisses of the 
lemma. < 



We are now ready to prove LemmafTSl 



Proof of Lemma l18l We define a non-deterministic PSpace algorithm to check whether a Dsum a- 
automaton does not satisfy the twinning property. The idea is to guess two runs on the same input 
word of size at most 4|Q|^ and two positions in those runs, and check the pair of states at the two 
positions are equal and that the respective delays are different. This algorithm uses a polynomial 
space (denomitors of the form A'™' are stored in polynomial space) and thanks to Lemma l25l is 
correct. < 



E.2 Proofs of Lemma [2T] and Lemma[20] 

We prove a stronger version of Lemma 1211 

► Lemma 26. Let f be an accessible state of Ad by a run pd on some word w € S*. 
Then the following hold: 

1. dom{f) is the set of states q such that there exists a run on w reaching q; 

2. Dsurr\\{pdT) = min{DsumA(^) | S, is a run of A on w}. 

3. If q G dom(f) and p is a run on w reaching q, then 

ff \ fA \ / 'w ' ■ f A ^ DsumA(p) - Dsumx{pdT) 
J (q) = max|delay(p, p ) \ p is a run of A on w} = ^j^^jj 

4. For all f : Q ^ Q and all a £ T, such that dom{f') = {q' \ 3q S t/om(/), {q, a, q') G S} and 
for all q' G dom{f'): 

f'{q) — '^^f^ + 7(9, a, q) — 'Jd{f, a, /') for some q G dom{f) such that {q, a, q) G 5 

A 

we have /' G Qd and (/, a, /') G Sd- 

Proof. The five statements are proved by induction on |w|. It is clear when \w\ — 0. 

Suppose that |w| > and w = w'a for some a G S. Let pd : .// / be a run of Ad on w' and 
let /' such that (/, a, /') G 5d, and td = (/, a, /')■ 

- The first statement is obvious by induction hypothesis and by definition of Sd- 

- The second statement is proved as follows: 
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DsumxipdT) 

= DsumA(pd) + Al'^l min{^ + -f{q, a, q') \ q G dom(/) A {q, a, q') G 5} 

= Dsum.(p,) + AlH ^i,| Dsum.(p)-^Dsum.(p,) ^ ^^^^ | ^ ^ ^^^^^^ ^ ^ 

by induction hypothesis and for some ran p : qj — > q. This is independ on the choice 
of p as any ran p' reaching q on w' satisfies DsumA(p') = Dsumx{p), as A is functional 
and q is co-accessible. 

= DsumA(pd) + niin{DsumA(p) - Dsumx{pd) + X^'^hiq, «i I 9 ^ dom(/) A {q, a, q') £ 5 
= min{DsumA(p) + Al'^^l^'^a,?') I 9 e dom(/) A {q,a,q') G 5} 
= niin{DsumA(p(g, a, q')) \ q E dom(/) A {q, a, q') E 5} 
= niin{DsumA(0 I ^ is a run on ?«} 
(as it is independ on the choice of p) 

- The third statement is proved as follows: Let q' E dom(/'). 

f'W) = ^+l{q,a,q')-jd{f,aj') 

(for some q E dom(/) such that {q, a, q') E 5) 

DsumA(p) - DsurriA pd) , . ,^ „,^ 
= ■yj^\ +7(g,a,g') -7d(/,a,/') 

(by induction hypothesis and for some p : qj q) 
DsumA(p) + Al"-l7(g, a, q') " DsumA(pd) - Al"'l7d(/, f) 

DsumA(p(g, g, gQ) - Dsumx{pdT) 

This value does not depend on the choice q. Indeed, any run p' that reaches q' on w satisfies 
Dsumx{p') = Dsumx{p{q, a, q')), as q' is co-accessible and A is functional. 
Then, we prove the second part of the third statement: 



Dsum x{p{q, a, q')) - DsnmxjpdT) 
Ds\imx{p{q, a, q )) — min{DsumA(^) | C a run on w} 

Dsumx{p{q,a,q')) -DsumxiO 
= max r-, f is a run on w [A'" 

= max{delay(p(g, a, q'), ^) | ^ is a run on w} 

which achieves to prove the lemma, as again, this value does not depend on the choice of the run 

p{q,a,q'). 

- We prove the fifth statement. Let /" be a function as defined in the fifth statement. We have 
seen that the value f'{q') does not depend on the choice of q. We can therefore use exactly the same 
proof as /' to prove that for all q" E dom(/") : 

f"{q") — max{delay(p, p') \ p, p' are runs of A on wa s.t. p reaches (7"} 

By definition of Qd, we get /" G Qd and by definition of 6d, (/', a, /") G ^d- < 

Proof of Lemma|20l First note that Ad is complete. Indeed, for all f E Qd and all a G S, there 
exists /' G Qd such that (/, a, /') G Sd- It suffices to define /' as follows: for all q' E Q: 

f'{q') = — h 7(9, a, q') - 7d(/, a, /') for some q E dom(/) such that {q, a, q') E 5 
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By Lemma l26l (statement 5), we get (/, a, /') e 5d- 

We show that Ad is deterministic. Suppose that there exists /, /', /" G Qd and a G E such that 
(/, a, /') G Sd and (/, a, /") G Sd- Clearly, by definition of 5d, dom(/') = dom(/"). Since /' and 
/" are accessible by definition of Ad, we can apply Lemmal20land we clearly get that f'{q) = f"{q) 
for all q G dom(/') — dom(/"). Therefore Ad is deterministic. 

Let us prove that La^ = La- Let w G We show that w G dom{Ad) iff w G dom(A). If 
w G dom{Ad), then there exists an accepting run Pd '■ fi f of Ad such that / G Fd- Therefore 
there exists q G dom(/) such that g G F. By Lemma l26l there exists a run of A on w reaching 
q G i^, so that w G dom(A). 

Conversely, if w G dom(A), then there exists an accepting run p : qj ^ q with q <E F. Since 
Ad is complete, there exists an accepting run of Ad on w reaching some / G Qd- Again by Lemma 
l26l we get q G dom(/) and therefore, since q ^ F,we have / G Fd- Hence w G dom{Ad)- 

Let w G dom{A), we show that Laj,{w) = La{w)- Since dom(A) = dom{Ad), w G dom(Ad) 
and therefore there exists an accepting run of Ad on w that we denote by : // ^ / G F^. 
Bv Lemma l26l DsumA(/9d) = min{DsumA(^) | ^ is a run of A on w}. Since w G dom(A) and 
dom(^) C (E — u; has necessarily the form w'^ and since all states of A are assumed to be 

co-accessible, all the runs of A on w are necessarily accepting. Therefore Dsum\{pd) = DsumA(0 
for some accepting run ^ of yl on w (the choice of ^ is not important as A is functional). In other 
words, LAaiw) — La{w)- < 



E.3 Proof of Theorem [22] 

Proof. The forth direction has been already proved (Lemma l20ll . We prove the back direction 
(i.e. the twinning property is a necessary condition). Suppose that the twinning property does not 
hold. There exist states p, q such that p and q are co-accessible and there exists words lui, W2 G S*, 
and runs pi : qj —4- p, p2 '- P P, p'l ■ qi --^ q, p'l '- q --^ q, such that delay(pi, p'j^) ^ 
delay(pip2,p'iP2)- 

We first show that there are infinitely many different delays. ForalH > 0,let A(i) — delay(/9i(p2)\ 
We show that for all j > « > 0, we have: 

X^M{A{j) - A(i)) = A(j A(0) (13) 

Let us first develop the expression A(j) — A(i): 

A(j)-AW 

_ D5umxipi{p2y) - DsutnA(/9i(P2)-^) _ DsumA(pi(/02)') - DsumA(pi(p2)') 
Dsuvnx{pi{p2y)-Dsumx{p[{p'^y)-X^i-'')\^-\Dsumx{pi{p2y^ 

\\wi\+j\w2\ 

We can rewrite DsumA(pi(p2)-'')-A(-''"*)l"'^lDsumA(/5i((02)*) into DsumA(/9i)-A(J~*)l"'2l DsumA(pi)+ 
A'^^I DsumA((p2 )"' ')' i-S- DsumA(/3i(/52)"' ') — A^^^*^'""^' DsumA(/9i). A similar rewriting can be 
obtained for Dsumx{p'i{p2y) - A(^-*)l'"2lDsumA(pi(P2)')- Therefore we get: 

Dsumx{pi{p2y-')-Dsumx{p[{p'2y"') A^^'')! "'^' (DsumA(pi) - DsumA(p;)) 

\\wi\+j\w2\ 

XU-^)M{Dsumxipi) - DsumAK)) 

X\wi\ + {j-i)\w2\ ' 

DsumA(pi) - DsumA(pi) , 



;^|«)i|+j|u)2| 

1 ,DsumA(/9l(/92)^"*) 



-(- 



DsumA(p'i(p2) 



\1\w2\ ^ }^'W^\^{j-i)\w2\ 

1 ^ DsumA( pi(p2p'') - DsumA(p'i(P2 V) 



\i|i«2 



(AO- 



Al"^! I+0'^*)I™2 

A(0)) 
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By Equation[T3] for all i > 0, we have A*l"'2|(A(i + 1) - A{i)) = A(l) - A(0). Since by 
hypothesis, A(l) ^ A(0), the sequence (A(i))i>o is either strictly increasing or strictly decreasing. 
Hence we get: 

V«,j>0, (i^j) =^ A{t)^A{j) (14) 

We use Equation [14] to show that A cannot be determinized. We suppose that there exists a 
deterministic automaton Ad = {Qd, fi,Fd,Sd,'Jd) equivalent to A and get a contradiction. We 
consider a word of the form wi (w2)% for i taken large enough to satisfy the existence of a run of Ad 
of the following form: 

// > J > J > J 

for some ki, k2 such that k2 > 0, and some /, f & Qd- 

Moreover, since p and q are both co-accessible, there exist two words , and two runs of Ad 
of the form: 

Pd ■■ fi > f > f > g 

Pd ■ fi > f > f ^ 9 

for some accepting states g, g' S Fd- Let pd ~ Pd,iPd2Pd,3 and p'^ = pd.iPd2P'd 3 for some subruns 
Pd,i,Pd2 that correspond to wi(w2)*'^ and (w2)'^^ respectively, and some subruns pd.3 and p'^^ 
that correspond to (w2)*~'^^~'^^ W3 and (w2)'^'°^^'°^W3 respectively. By equation [T4l we know that 
A(A:i) ^ A{ki + k2). We show that this leads to a contradiction. Let also : p pf and 

P3 : q — h qf be two runs in A, for some p/, qf G F. Then we have: 

Dsumx{pd,iPd,2Pd,3) = DsumA(pi(p2)V3) (15) 

Dsumxipd,iPd,2p'd,3) = DsumA(pi(P2)V3) (16) 

DsumA(pd,iPd,3) = DsumA(pi(p2)'"''"P3) (17) 

DsumA(pd,iPrf,3) = DsumA(p'i(p'2)'-'=^p'3) (18) 
From which we get: 

Dsumx{pd,iPd,2Pd,3)) - Dsumx{pd,iPd,2p'd,3)) = DsumA(pi(p2)V3) - DsumA(pi(P2)V3) (19) 
which is equivalent to: 

^hi|+(fei+fe2)h2|(DsumA(prf,3)-DsumA(p:i,3)) = Dsurr^xipM' P3) -Dsu^xip'MT P3) (20) 
Similarly: 

Al'"^l+"^l"'^l(DsumA(pd,3)-DsumA(p:i^3)) = DsumxipM'-"'' P3)-Dsumx{p'My-''' p'3) (21) 

Dividing Equation l20l by A'^^ 1™^ ' and combining it with Equation 1211 we get: 
DsumA(p.(P2)V3)-^DsumA(pUpyV^) ^ Dsu.A(p.(p2)-^-V3)-Dsu.A(p;(pi)'-V^) (22) 
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Let us rewrite the left hand side of Equationl22l 

DsumA(pi(p2)>3) - Dsumxjpiip^y p'3) 

\k2\w2\ 

\k2\w2\ 

;^hi| + (fci + fe2)h2|(DsumA((p2)'~'''~''V3) - DsumA((/52)'"'''"''V3)) 

Xk2\w2\ 

^ Xl^il+kiM^^^f.^ ^ f.^-j DsumA((p2)'"''^"'''V3) - DsumA((p^)*-'=^-'=V3)) 
Similarly, we rewrite the right hand side of Equationl22l 

DsumA(pi(p2)^-'=^P3) - DsumA(p'i(P2)'"'V3) 
= Dsumx{pi{p2)^^) - DsumA(p'i(P2)''0+ 

+ Al"'il+'=il'"2l(DsumA((p2)'~''""''V3) - DsumA((p2)'"''^'"''^V3)) 
= Al"'il+'=il"'2l(A(A:i) + DsumA((p2)'"'''"''V3) - D^^roxiip'^y-''^-''^ p'^)) 

Therefore Equation|22]rewrites into: 

XM+kiM(^A{ki + k2) + DsumA((p2)'"''^"''V3) - DsumA((py*-'^^-'^V3)) 
;^|^i|+feih2|(A(A:i) + DsumA((p2)'"''""''V3) - DsumA((p2)'"'''"''V3)) 
And therefore A(A;i) — A(fci + fc2), which is a contradiction. 



